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The purpose of this research was to develop an 
evaluation technique to assess how effectively children develop as 
independent learners within classrooms^ Implementing the Tucson Early 
Education Model. A situational task was chosen in order to gather 
information about the ongoing open classroom. The Classroom Attitude 
Observation Schedule was developed to detect pattern shifts in 
selected process variables in a classroom during the absence of the 
teacher and other "controlling" adults. The variables are grouping 
patterns, classroom. activities, and inappropriate behaviors* A pilot 
study of the CAOS was conducted, using six experimental (TEEM) 
classrooms and two comparison classrooms. The summary dependent 
variables were mean group size, mean number of children engaged in an 
activity, inappropriate behavior, mean number of groups, mean number 
of activities. The summary activity categories were traditional 
academic activities, nontraditional cognitive learning activities, 
play and role playing, snacks and management, and nonfocused * 
activities. Results showed the CAOS sensitive to pattern shifts. The 
clearest shift appeared with levels of inappropriate behavior. 
Children in comparison classrooms displayed more inappropriate 
behavior during teacher absence than did children in the TEEM 
classrooms* There were significant differences between teacher 
absence and teacher presence in Comparison claserooms but not in TEEM 
classrooms. The size of groups in which children clustered themselves 
changed significantly when the teacher was not present, (KM) 
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INTRODUCTION 

The research reported here is a part of the continuing program of de- 
velopment^ field delivery^ and evaluation of the Tucson Early Education Model 
(TEEM) , a participant program in the planned variation study of Head Start 
and Follow Through iince 1967. The TEEM was first developed to respond to 
the educational needs of low-income Mexican- American children in the public 
schools of Tucson^ Arizona* With the Inception of massive Federal funds to 
support innovative educational programs in the late '60 's, the U,S, Office 
of Education introduced a longitudinal research and development program to 
find out which of many collating early education systems were most efficac- 
ious In impacting on the educational perfonnance of low-income children. 
This study consisted of selecting over 150 cities in the country that sought 
high-quality early childhood prograns for their low-income ^Qhildren, md match- 
ing these school systems with over 25 different educational modelers who 
delivered their educational package to selected local classrooms * The imple- 
mentation of these programs has been accompanied by an extensive evaluation 
thrust, with both a massive collection of data on the national level, as well 
as discrete evaluation studies by program modelero and community staff. 
This particular research is part of a systisraatic study of the TBBM 
- program in terms of outcome variables not easily measured by our current arma- 
mentarium of research tools. 

PR0GRM4 DIhBNSIONS 

The Tucson Early Education Model is a process-oriented educational 
system with four areas of program obj actives for children: L«iguage Competence, 
Intellectual Base, Motivational Base, and, Societal Arts and Skills (Arizona 
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Center for Educational Research and Develapment , 1972). Theie goals arras 
are met through an intagrated claisroom environment which emphasiies the 
orchestrated development of behaviors in children. Other process variables 
fpcus on individualization of instruction^ the provision of a classroom en- 
vironment that provides gratification for children, and use of modeling pro- 
cedures to facilitate children's learning* This emphasis on a process approach 
to learnings as well as the focus on the whole childj lead to the description 
of the TEEM as an open classroom progrm ( Newsweek ^ May 5, 19713 * 

Among the many cited goals for children as a result of participation 
In an open-classroom environment^ one of the most commonly noted is that 
children become independent^ self -^directed loarners. This involves the ability 
to seek out learning materials and tasks, md to proceed in productive learn- 
ing relatively independent of adult direction or control* Our task then 
was to develop a systematic way to assess the independence of child learn- 
ing within the ongoing classroom environment. Additional direction was offered 
through a review of literature about the Follow Through Planned Variation 
Study, as summarised by Maccoby and Zellner (1970) in their text Experiments 
in Primary Bducatlon t In a discussion of the different conceptualization of 
the relationship between children's motivational set and thler classroom 
learningi they conclude: 

'To our knowledge^ evaluation procedures con^arlng the effective- 
ness of the various (Follow Through) programs have not attainted 
to assess how self-sustained the children's learning actually is. 
It would be possible to actually watch to see what happeni when 
the teacher goes out of the classroom- -whether the children find 
something to work on, or whether they sit passively or engage 
in horseplay. This has not yet been done in any way," (p, 75)* 

Such comments set the wheels in motion. The goal became to develop, an ob* 

servational paradigm that would permit an assassment of children's independent 

learning behavior through setting up a situation where the teacher was absent 
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from the classreom. This would provide a test of the "ego-strangth*» of chil- 
dren's learning commitment when the implicit adult authority was not present, 

^ffiTHODOLO^ICAL REVIEW 

The task of tha research praaentad here wai to develop an evaluation 
technique to asieas how effectively. Indeed, children do develop as indepen- 
dent learners within classrooms :impl emanating the TEEM. A review of avail- 
able literature indicated no extant studies with an adequate methodology to 
research ^'independent learning behavior'' (Simon and Boyer, 1970). This led 
to a review of available observational research techniques with a view to* 
ward developing a totally new technique, or modifying existing prpcedin'es 
to this end. At this point certain minimal criteria were set to develop a 
novel evaluation technique. The following criteria were set: 1) the techni- 
que should reflect actual behavior of childrenj 2) it should be unobtrusivei 
3) it should bevtfHawlth children from preschool through grade 3. 

We decided on the development of a situational task , that would provide 
information about process goals in the open classroom* A situational technique 
gathers information within an ongoing classroom setting, so that the infonuatlon 
reflects the real -world behavior of children and teachers. An additional 
feature is the introduction of environmental manipulation which put performance 
demands on the classroom members. Such events as fire drills or visitors 
naturally occur in all classrooms • In this research technique, quasi-^natural 
events are simulated! and used as oppgrtunitles to collect observational data 
on the continuing behavior of classroom participants. 

Situational tasks were described by Grimmett (1970) as useful procedures 
to assess the effects of experimental programs on the attainment of connative 
and motive hehaviors in qhildren. She notes the inadequacy of traditional 



-4- 

paper- and-pencil techniquas for gathering information in thefs crucial areas 
of child davelopment, A situational task (which she calls "situational test's 
1970) is defined as "a condition requiring an actual, adaptive responsej 
rather than a more 'test' response (and) ... problem confrontation, the 
resolution of which has some relevance for the 'real wcrld'^* (p. 12), These 
techniques are especially appropriate for assessing Ghildren's social perform- 
anee within the context where it was learned Ci.e*# in the classroom). 

CLASSROOM OBSBRVATION TECiiWIQUES 

Systematic observation of social interaction has only recently achieved 
respectability as a tool in educational research, Initial work by White and 
Lippitt (I960) and Flanders <1966) indicated the potential of observational 
methods to gather information on previously unresearched variables of class- 
room process. This research method has been widely developed now, as indicated 
by the voraminous reviews incorporated in the Mrrors for Bohavior monographs 
(Simon and Boyer^ 1970), One of the directions pursued by the U*S, Office 
of Education in the longitudinal research study of the Follow Through prograjn 
was the development of an observational system specific to the need to evalu- 
ate the Follow Through program at the national level. This technique, called 
Classroom Observation Instrument, gathers Information about the nature of 
Qiassroom intaraetion, the type of activities and group patterns, and the 
quality of the physical plant (Stallings, 1972). Classrooms are observed over 
a three day period, for a total of 36 five-minute interaction sequences. 
A review of this procedttt'e indicated certain features that would be adaptable 
to the task of assessing Independent learning behavior in children. With 
the encouragement of COI developers, we built upon their initial instrument 
to meet our research goal* 
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The Classroom Attitude Observation SchGdule has. been designed^ to detect 
pattarn ihifts in selected process variables in a classroom during the absence 
of the teacher and other ^'controlling" adults* Tliese variables are grouji^- 
ing patterns J types of classroom activities ^ and the occurrence of inappropri- 
ate behavioro . In order to investigate these patterns, the observation is 
divided into three phases. During the first twelve minutes Ccalled Basallne 
phase), observer records the activities of adults and children on the CAOS 
schedulej during the second twelve minutes Ccalled Teacher Absent phase) ^ 
the observer records the activities of children while the teacher figures are 
absent; during the third twelva minutes (called Relnstitutibn phase) , activities 
of both children and the returned teachings figures are recorded. The total 
CAOS observation takes 36 minutes, and is described in Figure r. 

Insert Figure 1 about here 

The observational technique counts children and adults engaged in the 
various classroom activities on a tlme-aample basis* All types of activities 
presumed to take place in the classroom are listed on the recording form 
(see Figure 2), Once every two minutes a clockwise visual scan is made of 
the room by the observer. The observer remains stationary throughout the 
thirty-six minute period, as the scan begins and ends at the same point for 
each scan. Numbers of children and adults observed during that scan -.are placed 
in the appropriate cell, thus rotainiug grouping patterns in the recording. 
If inappropriate behavior is observed during this scan, it is also noted by 
its associated activity and in the appropriate two-minute scan period. Two 
more scans are made during the two-minute period to pick up incidsnts of 
inappropriate behwior, once at the end of the first minute, and again at tha 
end of a minute and-a-half * 



-6- 

Procedurai and categories from two previously developed Instruments 
were synthesized to produce this particul^ procedure. Both of the parent 
procedures have been field tested and found reliable* 

One of the two instruments (as noted earlier) was developed by Stanford 
Research Institute* It is an interaction obsi^rvation technique developed for 
National Head Start and Follow Through evaluation efforts^ called Classroom 0 
Observation Instrument (Stallings* 19723* As a preamble to each five-minute 
interaction recording period, the observer takes a "snapshot'^ which gives the 
foundation for the CAOS technique. Activity definitions used by SRI have 
been redefined to make them more program specific to the Tucson Oarly ndtica* 
tion Model. 

SRI found this snapshot portion of their procedure highly reliable 
(better than 90% over thirty trainees in a stationary test situation) and 
the traAi.lng of observers relatively simple* 

The other parent instrument was dave loped at the Arizona Center and is 
called the Schedule for Incompatible Learning Behavior (SILB) CGrimmetti 
Under\^ood and Brackney* 1970). It was originally develuped for a study as- 
sessing the relaticnship of behavior settings to disruptive or inappropriate 
behavior. The inappropriate behaviors selected for coding in CAOS ares 
Hitting Yelling 

Inteffering Leaving room without permission 

Throwing 

These categories were.davelopQd. and ®P®^^*i°^^ll^®d in consultation with cl^^s- 
room teachers. Initial itudies indicated that these nategoriQs cntild be reli- 
ably rated by trained observers. 

The population of behavior to be sanrolod froin the TEEM classes with 
CAOS was that occurring during child selection time in a;.l cla^sroonis. This 
is the time when children chDOss their ovm activitis,^ from thoss available in 
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th© classrooffl. The decision to standardize procedures on tJiia fr^j© choic0 
time stermed from a combination of reasons ^ the most Important being that 
the bahavloral letting must be consistent across all classrooms* F^econdily, 
this was the time when children had the great&st latitude in setting their 
Q\m tasks for independent learning. 

Initial observer training consisted of a review of categories and their 
definitions^ and practice coding by both observers in the same classroom, 
without the manipulative phase* Aft#r practice codlngj the two observers 
met to cornpare coding and Isolate trouble spots* When definitions were not 
clearj they were re- worked until both observers could agree on their mean- 
ing and observability. The observers achieved reliability, with average 
agreement of 82%, and a high of 911 (Scott's j^j see Flanders^ 19663. It 
Was felt that this was high enough to permit comparability of observations 
made by the observers in separate observations. The CAOS observation sche- 
dule is seen in Figure 2. 

• 

PILOT STUDY 

Our initial devslopment effort indicated that the CAOS procedure was 
sufficiently developed to be utlllied in a field research study, This op- 
portunity was afforded through a commitment to investigate the Planned Varia- 
tion Head Start program. The Arizona Center was awarded a grant to intensively 
evaluate the operation of the TEEM Head Start in field operation (Rentfrow, 
Durnlng, Conrad and Goldupp^ 1972), The CAOS was incorporated into a multi- 
faceted design that also included child tests, teacher ratings, and family 
demographic data, " 

The study was carried out in a middle-sized community in the Great 
Plains. This community had a total of eight classrooms operating in their 

. ! ■ ' ■ 



Head Start program, six of which used the TEEM modal j and two using locally- 
implemented curriculum. Thus, a researdi design^ using six experimental^ 
and two comparison classroc'Tis^ was implemented. In the classrooms, over 
90% of the children were Anglo, as were the two research staff who did the 
CAOS observations. A total of eight classrooms was obsarved during the 
Spring of 1972j and each received one CAOS observation, 

INITIAL ANALYSIS ^ 

The purpose of the CAOS pilot study was to discover pattarn shifts given 
the absence of classroom '^contfolllng" adults. Such shifts could take many 
forms. The variables described below are those that might demonstrate con- 
trols which are largely adult centered versus controls internalized by the 
children or imposed by the physical or behavior setting. A nioaningful pat- 
tern would be one in which the variable increases or dacreasss during teacher 
absence and returns to the level exhibited during Phase A, wlien teacher re- 
turns in Phase C. A stable pattern, then^ would be one in which all three 
phases look much alike. Three principal questions were being asked. 

1. Are there differences betv;een observation phaaes on any of the 
summary variables? 

2. Is there a differance between TEDM and Comparison classrooms? 

3. Is there interaction between classroom assignment and observa- 
tion phase? (Goldupp^ 1972). 

To analyze the data, a two by throe factorial design was used. One inde- 
pendent vai'iable used was classroom assignment (TEEM and Comparison) * The 

■^This information is adapted freely from another paper entitled *'An 
Investigation of Indspendent Child Behavior in the Open Classroomr The Class* 
room Attitude Observation Sched'^^^^^^ Ocea Goldupp. This paper is available 

for SO* from I Information Officeri Arizona Center for Educational Research 
and Development, University of Arizona, 1S15 East First Street, Tucson^ Arizona 
85719, 



other Indapandent variable was observation phase (Phaies A, B, and C) . Phases 
were tveatad as repeatid measurei on the same subjects. This analysis was 
repaated using each of the five summary variables as the dopendent variable. 
The summary dependent variables werei 

1. Mean group si^e 

2. Mean number of children engaged in an aQtivity 

3. Inappropriate behavior 

4. Mean number of groups 

5. Mean number of activities ^ 

Mean group size was calculated by dividing total number of children 
counted in a twelve-minute phise by the number of groups cojuntod in that 
phase. Mean number of children engaged in an activity at any one time during 
the twelve-minute phase was calculated by dividing the total number of chil- 
dren counted in a phase by the number of cells! 'used in the phase, InapprO' ^ 
priate behavior was simply a total count of incidents of inappropriate be- 
havior observed during the twelvt-^minute phase, Menn number of groups was 
calculated by dividing number of groups counted in a phase by number of two- 
minute scans in the phase. (In all but two instances^ there were six scans 
for every phase) . Me an number of activities was calculated by dividing num- 
ber of aciivity cells used in a phase by number of two-minute scans in the 
phase* 

Another analysis used independent ratings of teachers* The Lincoln 
Head Start Eirector was asked to rate all of the teachers on level of imple* 
.mentation of the TEEM, The scale was a Likert Form with 1 to 9 levels. 
The lowest teacher rated was a "2' and the two highest were Since 
these ratings were/assigned Independently of the variables examinod for CAOS, 
on© high-rated teacher was selected at random from the two high rated teachers 
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and was con^sared with the low rated teacher on the variable showing greatest 

variation in CAOS in froup data (i.a*, inappropriate behavioT) . (see Figure 3)* 

For fuithar txaniination of the data> activity eategories were collapsed 

into five iummary categories, . 

Type I consists of ''traditional" academic activltiea and includes arith- 
metic^ language^ social studies and science^ 

Type II consists of cognitivs Igaming activities for young ^lldren 
but not in the "traditional'- sense* InGludad in this type are storiesi 
games* puiiles, arts^ crafts, cookings and building. 

Type III Qonsists of play and role playlngt 

Type IV eonsists of snacks and management* Management activltieB are . 
those involved in managing the room, including cleaning up, handing out 
ipaterlals, and going after supplies. 

Type V consists of non-focused activities such as transitional aQtivities 
children out of the room, and wandering. 

These five activity types were used to examine the proportion of time 
spent by adults and children in each activity dwing Phases A and C combinedi 
These data were examined with Spearman mO rank order correlation comparing 
the. same high-rated classroom and low-rated classroom. 

Table 1 shows the results of analysis of variance of each of the five 
sumsaiy variables » Analysis of the first summtay:^fvariable, mean group size, 
indicated that differences among phases Were significant Cp<.10). There was 
no significant difference between classroom styles. 

The most conspicuous difference appeared with the second summary vari- 
able^ inappropriate behavior, Malysis of this variable Indicated that signi' 
ficant differences existed in both independent variables, group and phase, 
as well as the interaction between these variables (groups P^*10j phases 
p<.001; group by phasei p<,05). Figure 3 gives graphiQ demonstration of 
the group*by-phas8 interaction. . 

Further analysis of these summary varlri^les was conducted using the 
N6wman--Keuls post hoc test , Since cell si^es were unequal the Ka"rmnni& 



of cell n'i was Uifd as an istiffliti of n CWlntrj 1962). Alpha level for this 
test was sat at ,0S» The teachar absent phaje in Comparison classrooms wai 
significantly different from eveiy other cell* No other signifieant diffarinees 
were found. 

No signlficint F-ratlos ware ©btalnid for the other three sumary vari- 
ables tested, mean activity size, oean number of grwips, and mean number of 
activities r 

iVhen proportion' of adult participation in each^^of the five aQtivity 
types wai conpareii to proportion of child participation In the^ same activity 
types during the same phases, rank order correlation between adult partial- 
patlon and child partlcipatlDn in the low rated clasiroom was -.27 (Figura 
4). In the high rated classroom, the eorrelatlon between adult md child 
participation was *80* CFlgure S), 

CQNCLUSIONS 

The CAOS system la clearly sensitive to pattern shifts in some aspects 
of child behavior. The clearest pattern shift appeared with levels of in- 
appropriate behavior. Children In the two comparison classrooms dlsplaytd 
more inappropriate behavior during the teacher absent phase than did the 
children in TEBM classrooms, the post hoc tests demonstrated no significant 
differences between level of inappropriate behavior in TllM classrodm and Com- 
parison classrooms during the teachir present phases. The dlffarenees between 
these two groups during teacher absent phase was significant Cp<, OS) * 

Within the TEEM classrooms I children in the classroom rated lowest by 
thi Head Start Diffctor diipliyid mor# inftpproprlate behavior during teacher 
absence than did children in the high-rated classroom* It also held true 
there wert significant dlfferencei between teacher absent and temcher present 



phases in Comparison clasirooms, while there wtrt no significimt differences 
bitwitn phasis in TEEM classrooms. These comparisons also appeared to exist 
between the low^ rated and the high-rated classroom. 

The system picked up other indications of ihifting patttrni during 
teacher absence. One which was itatistically significant was the area of 
mean group liEt, The si^e of groups in which chidren clustered themselves 
changed sigriifleantiy when the teacher was not present. The difference 
demonstrated by this variable was significant when all eight classrooms ware 
examined acrois phases. 'Hiire wtre no iignif leant differences between TEEM 
classroomi and Con^parlson classrooms on this variable,. 

NEW DIRECTIQNS 

The development and pilot utilisation of the CAOS procedure in Head 
Starts classes indicated the potential of the ttehnique for both formative 
and sunmiative data collection purpoifit This has lad to a current effort 
to collect CAOS in a nationwide §mplQ of 40 classrooms using the TEEM in 
th? Follow Through progran* Initial inspection of fall data indicates that 
the teehique is likewise sensitive to ongoing clasirggni process with older 
children. Another data set is being collected this Spring to analyze the 
sensitivity of CAOS to change in classrooms over a school year. This informa- 
tion will be raported next year at this time^ 



Alpha level was set at .10 for this Initial analysii, since the s 
was a pilot. 
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Table 1 

Comparison of TEEM x Comparison Classrooms 
across Phases for Selected CAOS Observation 
Smpary Variables 
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*P<.10. 
**p<.05. 
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Figure 1* Phases of CAOS 



-17- 



O 
< 



U 

m 
u 

Q 
1= ■ 
< 

ii 
Q 

p 

t 

1 

y 



E 

t 

a 



8 















































































z 






































< 






































z 












































- 




































































< 






































z 




























- 










<: 






































































































































• 


















IJ. 


IJ 
s 


tf| 


E 

11 

Si ■ 


fa 


a a. 

sJ ; 

3 




i 3 




g J 

i 3 
u 5 ; 
f\ a* ^ 

4 


§ i 
1^ t 

i 


i ^ 
f 

s >^ 

Q q 


e 
= 


c « 

5 

i 1 


1 ^ 
1 ^ 

*« C 


B 
1 

5 


So 
J 


1 
j 


i 



f "c" 

I 

I ^ 
I ^ 

s 

f wo 

"5 

a 



Q 



o 
u 



T3 
Q 



o 



»F" - 

o 
u 

£: 

m 

© 



-18- 




• Figure 3. Incidents of Inappropriata Learning Behavior in TEEM 
and Comparison Classrooiiis across Observation Phases. 
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